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We consider a financial market model which consists of a financial 
asset and a large number of interacting agents classified into many 
types. Different types of agents are heterogeneous in their price ex- 
pectations. Each agent can change its type based on the current em- 
pirical distribution of the types and the equilibrium price, and the 
equilibrium price follows a recursive price mechanism based on the 
previous price and the current empirical distribution of the types. 
The interaction among the agents, and the interaction between the 
agents and the equilibrium price, feedback, are modeled. We analyze 
the asymptotic behavior of the empirical distribution of the types and 
the equilibrium price when the number of agents goes to infinity. We 
give a case study of a simple example, and also investigate the fixed 
points of empirical distribution and equilibrium price of the example. 



1. Introduction. Stochastic models of interacting systems play an im- 
portant role in population biology and statistical physics, c.f. [17] and [3]. 
In recent years a number of leading thinkers have expressed the need for de- 
veloping economic models that incorporate interactions between agents and 
evolutionary mechanisms, see [22] and [6]. Agent-based models (ABMs), 
which arise from many areas of science and social sciences such as ecology, 
artificial intelligence, communication networks, sociology, economics (see [8], 
7], [21], [27]) are the ideal choice to attain this goal. The following features of 
ABMs (see [10]) are fundamental. Firstly, precise mathematical formulation 
can be described by ABMs, which make clear, quantitative and objective 
predictions possible. Secondly, the explanations that link the analysis of the 
individual agent level and the analysis of the emergent aggregate level can 
be bridged by ABMs. 

In this paper we will concentrate on the agent based modeling in a finan- 
cial market. At first, we give an account of some aspects of the related works 
done by other authors. Black [2] classified traders as information traders and 
noise traders. Follmer and Schweizer [9] considered an interacting agent fi- 
nancial model in which they used Black's classification of traders. They 
assumed the number of traders being countable and introduced an individ- 
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ual excess demand function which takes a simple log-linear form. Lux (see 
[18], [19] and [20]) assumed the number of agents being finite, and divided 
the traders into three types: chartists, optimists, and pessimists. In Lux's 
model, the types of traders can be changed probabilistically, according to the 
profitability of each type; there are new entrants into the market and exits of 
current traders from the market. Horst (see [12], [13], [14] and [15]) consid- 
ered the interacting agent models with local and global interactions. Horst 
classified the traders into three types: fundamental optimistic traders, fun- 
damental pessimistic traders and noise traders. Let A be a countable set of 
active agents and A n be a sequence of finite sets satisfying linin^oo A n = A. 
At each period t > 0, each fundamental trader has its mood, e.g., xf = +1 
for being optimistic or = —1 for being pessimistic. Let C be a fixed set of 
individual states, i.e., xf G C for each a £ A and t > 0. Let xt = {xf } a <=A- 
Horst defined the empirical distribution as follows: 

(LI) Pt = p(x t ) = Jim^-J— 5 x a(-). 

p(xt) is called the mood of the market at time t. The market mood drives 
the market price in the following way: 

(1-2) p t+ i = G(p t+1 ,p t ), 

where pt is the market price in period t and G is a certain function. Assuming 
a simple log-linear structure for the excess demand function, Horst got the 
recursive log price formula of the following form: for each period t > 0, 

(1-3) logft+i = f{pt+i) log p t + ff(pt+i). 

The mood for each individual a £ A evolves as follows: 

(1.4) n a (xt +1 = s\x t , e t+ i,h t ) = vr(x" +1 = s\x%, e t +i, h t ), 

where s € C, and et+i ~ Q(p(xt);-) is the signal of the market mood 
p(xt) and ht is some (exogenous) economic fundamentals revealed in period 
t. Therefore, in Horst's models, traders can change their types during the 
evolution of the models and there are interactions among traders. But there 
is no feedback of the price pt on the evolution of individual state, i.e., the 
current market price has no impact on the change of types for the next time 
period. 

As was illustrated above, the empirical distribution of the types of agents 
can link the behavior of individual agent level, the emergent laws of aggre- 
gate level, and the equilibrium price of certain financial asset. This paper is 
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the second attempt of a systematic study of the interacting agent financial 
system. Another working paper of the author focuses on the multiagent mod- 
els evolving in time- varying and random environment, see [29]. We construct 
the interacting agent feedback finance model (IAFFM) by using agent based 
modeling. The most general assumptions about the mechanism of IAFFM 
are as follows: 

1. The time is in nonnegative integer units, denoted by k > 0. 

2. There are fixed N > 2 agents in the financial market at all times. 
There are no entries of new agents into the market or exits of current 
agents from the market. 

3. There is a financial asset in certain market whose price S^ik) varies 
with time k. 

4. Each agent has one and only one internal state from an internal system 
with r > 2 states denoted by 1, • • • , r. The internal system does 
not change with time k, i.e, at each time period k > 0, there is no 
new state added to it and no existing state removed from it. The 
agents are classified into r types according to their internal states, 
and n N (k) = (n^(k), ■ • • (k)) is the distribution of these agents 
among the r types. It follows that (k) + • • • + (k) = N by the 
third assumption, and - ^ is the empirical distribution of the types 
of agents at k > 0. 

5. There exists a log price mechanism for the financial asset. Let Z + = 
{0,1,---}, K N = {N~ l a : a G (Z + ) r ,Ei=i«i = N ), and 9n be 
defined on [0, oo) x K N x R. At time k > 1, q N (jjf) = log S N (k) 

is determined by q N (^-) and n ^ through the following recursive 
formula: 

M = + ^.^»- 

6. Assume that Pn(-, •> ■) = {PN,i,j(-, - ))rxr 1S a deterministic stochastic- 
matrix valued function defined on Z + x Kn x R which represents the 
external environment of the multiagent system. 

7. Based on all the information of the agents' types, the equilibrium prices 
of the financial asset, and the external environment up to time k, each 
agent has an independent strategy of probabilistically choosing its type 
for the next time unit k + 1. The strategy of an agent is realized by 
keeping or changing its type. The agents of the same type have a 
common strategy. That is to say, from time k to k + 1, the agents of 
type i switch to type j with probability PN,ij(k, - ^ , q~ N (j?))- This 
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process of changing types occurs locally among agents of the same 
type. 

Note that Sn and depend on N, which means that the price mechanism 
does reflect the influence of the size of the market. The gross performance of 
an economy consists of an external environment. The economic fundamentals 
of the financial asset can be reflected in g^. An example will be given in 
Section 4 to illustrate these. The assumptions 1-7 above will be used to 
mathematically formulate IAFFM. When we assume that P/v(-,-,-) or g^ 
are random, we can construct IAFFM evolving in random environment. 

In this paper we will mainly study the asymptotic behaviors of {( - ffi^ , 
Q N (^r))it > 0} as N — > oo. One feature of our model is that the transi- 
tion structure of the types and log equilibrium price is time-inhomogeneous. 
Another feature is that the equilibrium price of the financial asset has feed- 
back on the transition of the agent's types, instead of just being driven by 
the empirical distribution of the agents' types. Therefore, we modeled two 
kinds of interactions: the interaction among the agents, and the interaction 
between the agents and the equilibrium price. 

This paper is organized as follows. In Section 2, we formulate IAFFM and 
state the main Theorem (Theorem 2.1). In Section 3, we give a complete case 
study of a simple IAFFM example. We make assumptions for this example, 
verify its conditions required by Theorem 2.1, and discuss its fixed point 
problem. We also make connections with the classical stock price formula 
for this example. In Section 4, we give the proof of Theorem 2.1. In Appendix 
A, B, and C, we give the proof of Lemmas 3.1, 4.2, and 4.3, respectively. 

2. Formulation of IAFFM and Main Theorem. Let R + = [0, oo) 

and K = {a : a € {R+) r , Ya=i a i = !}• 

Condition 2.1. A(t,x,q) = (aij(t,x,q)) rxr is a r x r matrix-valued 
cadlag function on [0, oo) x K x R, which satisfies the conditions as follows: 
for each (x, q) £ K x R, 

1) A(-,x,q) € ZV*--[0,oo); 

2) A(t, x, q)e = rx i for t > 0, where e = [1, • • • , 1]'; 

3) aij(t,x,q) > for t > 0, and 1 < i, j < r, i ^ j. 

Condition 2.2. For each N > 1, A N (t,x,q) = (a,N,i,j(t,x,q)) r 
r x r matrix-valued function on [0, oo) x Kjy x R, which satisfies the following 
slightly different conditions: for each (x, q) € Kn x R, 

1) A N (-,x,q) G D^rxr[0, oo); 
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2) A N (t,x,q)e = rx i, t > 0; 

3) aN,i,j(t,x, q) > for t > and 1 < i, j < r, i / j. 

4) Aiy(t,x,q) is a constant on t G [j^, /or > 0. 

Next, we specify the functions which are related to the log price mecha- 
nism. For each N > 1, we have defined g]\r(t,x,q) on [0, oo) x x R. We 
also define a real valued function g(i,x, q) on [0, oo) x K x R. We are only 
concerned with functions which are 'linearly' growing in g, i.e. 

(2.1) g(t, x, q) = tp(t, x, q)q + x, g), 

(2.2) £/v(*, x, q) = tp N (t, x, <?)g + ip N (t, x, g), 

where <p(t, x, g) and ^(i, x, q) are functions on [0, oo) xKxR, and </?/v(i, x, q) 
and ipN(t,x,q) are functions on [0, oo) x Ajy x -R- 

Let X"(t) = g"(t) = g~^(ifl) and Y*(t) = (X*(i),g"(t)). 

(1.5) represented by the new notations is for t>jr, 

(2.3) q N (t) = q\t - 1) + JL^(M, X "(t), g"(f - 1)). 

Now we formulate the transition structure of IAFFM as follows. For k > 0, 
(x, g) € K N x i?, let 

1 k 

(2-4) Pjv[fc,x,g] = J+— A N (—,x,q), 

where I is the identity matrix of order r. For each fixed k > 0, (x, g) 6 
A'tv x i?, P/v[fc, x, g] is a stochastic matrix for large enough N. Assume that 
n (0) and £^(0) are given. We define the time inhomogeneous Markov chain 
{(n N (k), g JV (^))}fcL by mathematical induction. Assume that for k > 0, 
(n JV (A:), q N (-ft)) is defined or given, we want to define (n N (k + l),q N (^-)). 
By the assumption 7 in Section 1, for 1 < i < r, each agent of type i can 
change its type to j, with probability p N)i)j (k,X N (jj),q N (j^)) (1 < j < r). 
Since the nf (k) agents of type i independently make their transitions, the 
distribution of these nf (k) agents among the r types at time k + 1 is a 
random vector denoted by = (£,N,k,i,i, • • • , £iV,fc,i,r) on some probability 

space, which satisfies 

(2.5) S NAi ~ multinomial (nf (fc), P^. [A;, X 7V ( A), ^( A)]^, 

where Pjv,i.[fe, X 7V (^), g^(^)] is the i-th row of matrix P N [k, X N (%), q N (%)]. 
Since the agents with different type change their types independently, Sjy^i, 
• • • , Sjv,fe, r are independent. Then, we define 

(2.6) n N (k + 1) = S Nk l H h Swi n 
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and q N (^jf-) by formula (1.5). 



N 

For each N > 1, we define the transition operators of {(X Ar (-^), q N (jj)),k > 
0} as follows: for each k > and / G C{Kn x R), the set of bounded con- 
tinuous function on X R, for (x, g) G Kn x R, 
(2.7) 

=E[f(X N (^),q N (^))\X N (t) = X,g*(|) =q]. 

We expect that the transpose Y' of any limit Y of Y^ is a solution of 
the following differential equations: 

(2.8) ^ = A(t,x(*),g(t))'x(t), 

(2-9) ^=g(tMt),q(t)), 

which satisfy the initial conditions x(0) = X(0)' and g(0) = Q(0). 

Let K x R be the state space for the limit process and denote by C(K x R) 
the set of bounded continuous functions on K x R, and define C C (K x R), 
C\(K x R), C 2 C (K x R) by 

(2.10) C C (K x i?) = {/ G C(X x i?), / has compact support on x 
(2.11) 

C^-ftT X R) = {/ G C c (if x R), ^ and ^ are continuous on K x R}, 
(2.12) 

C r (KxR) = {/ G C r (KxR), — — jr. - - , and — are continuous on KxR}. 

ax" 1 axag aq^ 

We define the time-dependent generator {GU(s), < s < 00} on C\(K x R): 
for each / G C\{K x 22), and s > 0, 

df df 

(2.13) GU(s /(x, g = xA(s, x, g)/- + g(s, x, g)/, (x, q) £ K x R. 

ox ag 

@{Ga) = C\{K x R) is the common domain of the generator {Ga(s),0 < 
s < 00}, and D = C^(K x R), is a subalgebra contained in @{Ga). 

Condition 2.3. For each f G C^(K x R) and T > there exist mea- 
surable sets {Fn} C R such that 

(2.14) lim sup sup du(A N (-,x,q), A(-,x,q)) = 0, 

(2.15) lim P{q N (t) e F N ,0 < t <T} = 1, 

N—*oo 
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where djj is the uniform metric on Dfirxr[Q, oo) defined by 

roo 

du(u, v) = / e~ s sup [||u(i) — v(t)|| r A l]ds, u, v e % X r[0,oo), 

JO 0<t<s 

and || • || is the matrix norm. 

Condition 2.4. For any T > 0, 

(2.16) lim sup sup |</>jv(i,x, q) — y>(i, x, g)| = 0, 

N ^°°0<t<T (x,q)eK N xR 

(2.17) lim sup sup |V>jv(i,x, q) — tp(t,x, q)\ = 0. 

7V- > oo < t < T ( Xs q)eK N xR 

Condition 2.5. For any compact subset K of K x R, there exist C > 
and A > 0, such that A(t,x,q), (p(t,x,q) and ip(t,x,q) satisfy that 

(2.18) sup \\A(t,x,q)\\ <Ce xt , 

(2.19) sup \ip(t,x,q)\ <Ce Xt , 

(x, ff )ex 

(2.20) sup |^(t,x,g)| <Ce xt . 

(x,?)eK 

We introduce the following notations: 

r 

(2.21) &i(*,y) = ^2xjaji(t,y), l<i<r, and y = (x,q) 

(2.22) &r +1 (t,y) =<?(*, y), 
(2.23) 

b (*>y) = (6l(*>y),--- A+i(*,y)) and b(i,y) = (&i(t,y),-" , &»■(*> y))- 

It is clear that (2.8) and (2.9) with the initial conditions x(0) = X(0) and 
q(0) = Q(0) are equivalent to the integral equations 

(2.24) y(t) = y(0) + f b(s, y(s))'ds, t > 

Jo 

or 



(2.25) x(t)=x(0)'+/ b(s,x(s),g(s))'ds, 

Jo 

(2.26) q(t)=q(0)+ [ g(s,x(s),q(s))ds. 

Jo 
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where y(0) = (x(0),g(0)). (2.25) and (2.26) are nonlinear Volterra equations 
of the second kind. 

(2.25) and (2.26) are assumed to satisfy the semi-Lipschitz conditions, 
which are guaranteed by the following condition. The definition and property 
of semi-Lipschitz condition are included in Section 4. 

Condition 2.6. For any T > 0, there exists a nonnegative L 2 ([0,T], R) 
function Cx(t), such that for any < t < T and yi = (xi,gi),y2 = 
(x 2 ,i?2) €K x R, 

(2.27) ||b(t,yi)-b(*,y 2 )|| <C r (*)||yi-y 2 ||. 

g satisfies that for fixed T > and any K-valued continuous function x(t) 
on [0, T], (2.26) determines a unique solution q x (t) on [0, T], and for any 
two solutions (x(t),q x (t)), (k(t),qz(t)) of (2.25) and (2.26) on [0,T], there 
exists a nonnegative measurable function B(s) on [0,T], such that q x (t) and 
qz(t) satisfy 

(2.28) / (q x (t) - qz(t)) 2 dt < B(s) f ||x(t) - it(t)\\ 2 dt for < s < T 
Jo Jo 

and 

r-T 



(2.29) / [f S C T (t) 2 dt(l + B(s))]ds < oo. 

Jo Jo 



Theorem 2.1. Assume that A(t,x,q) = (aij(t,x,q)) rxr satisfies the 
condition 2.1 and {A/v(i,x, g) = (a,N,i,j(t, x, q)) r xr} satisfies the condition 
2.2. Assume that g(t,x,q) and {gN(t,x,q)} satisfy (2.1) and (2.2). Assume 
that (p, ip, ^ are continuous. Assume that the condition 2.3 holds for 
{An} {q }, and A, and the condition 2.4 holds for {(Pn}, <P and {4>n}, 4>- 
Assume that A(t,x,q), ip(t,x,q) and ijj(t,x,q) satisfy the condition 2.5 and 
are bounded on [0, T] x K x R for any T > 0. Define h(t, y) and h(t, y) by 
(2.21), (2.22) and (2.23). Assume that either h(t, y) satisfies the Lipschitz 
condition or the condition 2.6 holds for (2.25) and (2.26). Suppose that 
P(Y N (O))^ 1 =>• fi for some fi € &{K x R), then there exists on some 
probability space (Q,^,P) a stochastic process Y satisfying P(Y(0)) _1 = 
H, which is the unique solution of the Ckxr[^,oo) -martingale problem for 
(Ga,^) restricted to C 2 (K xR) and for P-a.s. oj G Q,, Y(t,u)' is the unique 
solution of the integral equations (2.25) and (2.26), such that Y N =>■ Y. 
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3. Case Study of a Simple Example. 

3.1. A simple example of IAFFM. There are N agents in a financial 
market which consist of fundamentalists, optimists, and pessimists, see [20]. 
At each time k > 0, the number of fundamentalists, optimists and pessimists 
are n^(k), (k), and (k) respectively. This interacting agent system is 
closed, i.e., there are no new entrants into the market or quits of current 
traders from the market. Therefore n^(k) + (k) + n^(k) = N for all 
k > 0, and n N (k) = (n^fc), ra^ {k),n^ (k)) is the vector of types. 

Each type of agents have their own excess demand functions. The excess 
demand functions have the form of Fdllmer and Schweizer, see [9]. Assume 
that there exists a probability space (f2, J^, P). At time unit k > 1, for each 
uj € f2, and a proposed price p, each agent a has an excess demand function 
e a {k-iPi 00 ) which is given by 

(3.1) =^{^)\o g {S*M/ P )+ 



rNf k 



Here 5^(jj,uj) can be viewed as the total liquidity demand observed by 

agent a at time k > and - — is the average liquidity demand, and 
S^ k (uj) denotes an individual reference level of agent a at time k. The time 



scale for and 5^ is of i, instead of 1. 



Denote the individual reference level S^ k (u>), the coefficients ct„ 
and 5a (jj,uj) for fundamentalist, optimist, and pessimist by S^(k, u), af r (-^, uf) 
and o~f (jj, oj) (1 < i < 3) respectively. We assume individual reference levels 
as follows: 

(3.2) 

\ogS^{kM=^gS N {k-l) + Pl K -f \ \ gS N {k-l)-\ogF N {-^)), 
(3.3) 
log, 
(3.4) 

log S?(k,u) =log S N (k - 1) +p^(^,u;)(logS N (k - 1) - log p), 

where random coefficients (3^{jj,uj) < (1 < i < 3), F N (j^,u) is the fun- 
damental value of the asset at time k. Note that only j3^(jj,uj) in the fun- 
damentalists' reference level is divided by N, the market size of the agents. 
One reasonable explanation for it is that fundamentalists know the evolution 



log §?{k,u) =log S N (k- 1) +/^(^ jW )(logS JV (fc- 1) -logp), 
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of fundamental value F N (jf,ui) of the asset, they value less in their excess 
demand functions the difference between logSjv(& — 1) and log F N (-^, u). 
Note also that the time scale for (3^, 02 , (3% and logF^ is also of A. 

For each k > 1, if we assume the price S^(k — 1) and n (k) are known, 
then the equilibrium log price log Sw(k) is determined by the market clearing 
condition of zero excess demand: 

(3.5) *EeZ(k,S N (k),u)) = 0, 



i.e., 

(3.6) £nf(fc) 



a?A(logS»(k)-logS N (k)) + °* [n) 



0. 



We have omitted u in the random variables in the above equation and in the 
rest of this subsection. Substituting (3.2), (3.3), (3.4) into (3.6), and solving 
for logp as log Sty (fc), we get 
(3.7) 

log S N (k)- log S N (k-l) 

1 <(fe)af (#)/?r (^)(\og S N (k - 1) - log F N (jj)) 

N ' <(&)<(£) + n?(*)a^(#)(l + /?f(#)) + nf (£)(1 + 

1 <W^(#) + ngWgU) + n^WTO) 

N n?(k)a» (£) + n^(fe)af (A)(l + + n^(fc)af (^)(1 + /f(#)) 

(3.7) is a recursive log price formula. 

Let K% = {JV _1 x : x G (Z+) 3 , £f =1 s< = N}. Define ^ on [0, oo)xK%x 
R as follows: 
(3.8) 

Xl a^{t)^{t)q 



g N (t,x, q) 



x ia ?(t) + x 2 c$(t)(l + /^(t)) + z 3 af (t)(l + /3^(t)) 
si$f (t) + x 2 ^(t) + x 3 *f (*) - xi< (*X (<) log F N (t) 



+ 



xi<(£) + x 2 a^(t)(l + /5f (*)) + a*c^(t)(l + /9f(*)) ' 
Then (3.7) can be represented by gN(t,x.,q) as 

(3.9) log Sjv(fc) = log S N (k - 1) + ^v(^, -^ v - i , log SW(* - 1)). 

Note that gj\r(t, x, g) defined by (3.8) is a random function. We have actually 
made preparations for the IAFFM evolving in a random environment. 
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We also define Aj^(t, x, q) = (ajv,jj(i ; x, <7)) 3X 3 on [0, oo) x x R sat- 
isfying the Condition 2.2. Then we can specify the transition structure for 
{(n N (k), log <S/v(^))}fciLo same wa Y as that in Section 2. 

In this example, af , , Sf (1 < i < 3), and F N consist of the external 
environment of the interacting agent financial system. F N is the economic 
fundamental of the financial asset. 



3.2. Assumptions and verifications of the example. In this subsection, 
we make assumptions for the example and verify the conditions of Theorem 
2.1 for this example. 

Assume that af (t), ffi(t), and 5f{t) for 1 < i < 3 and log F N (t) are real 
valued functions defined on [0, oo). Assume also that for any x € K% and 
t > 0, xxaf (t) + x 2 a% + (t))+x 3 ag (t)) + 0, which justify 

the definition of in (3.8). Then we can define real valued functions ipjy, 
TpN on [0, oo) x Kff as follows: 



(3.10) <p N {t,x) 



Xl a?(t)PF(t) 



xia?{t) + x 2 c${t)(l + $(t)) + x 3 c$(t)(l + flf(i)) ' 

(3.11) 



V>at(£,x) 



aigfft) + s 2 <ff (*) + ggjTO - giaffflg; (t) log F^t) 
x ia f (t) + x 2 o^(*)(l + /3f (t)) + x 3 of (t)(l + /^(i)) ' 



9n, <Pn and ^jv so defined satisfy the relation (2.2). 

Now we make the general assumptions which justify the description of 
the limit process {y(t) = (x(t),q(t)), < t < oo}. 

Let K 3 = {x : x € (i?+) 3 ,E?=i^ = !}• Let Oi(t), &(*), <$i(t) (1 < » < 
3), and F(i) are continuous real valued functions defined on [0, oo), where 
F(t) > for each t > 0. For any x G K 3 and i > 0, ziai(t) + x 2 Q!2(t)(l + 
/3 2 (t)) + x 3 a 3 (t)(l + / 0. aj(t) and /3,(i) (1 < i < 3) are bounded on 

[0, oo). There exist constants C > and A > such that for t £ [0, oo), 

(3.12) \6i(t)\ < Ce xt for 1 < i < 3 and | logF(t)| < Ce At . 

A(£,x, g) satisfies the Condition 2.1 and is bounded on [0,T] x K 3 x i? for 
any T > 0. For any compact subset of R, there exist C > and A > 
such that for any t > 0, 

(3.13) sup ||A(t,x,g)|| < Ce Af . 
A(t, y) also satisfies the Lipschitz condition. 
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Based on the above assumptions, we can define real valued functions g, 
if, ip on [0, oo) x K 3 x R as follows: 



(3.14) 



(3.15) tp(t,x) 



(3.16) V(t,x) 



scioi(t) + x 2 a 2 (t)(l + (3 2 {t)) + x 3 a 3 {t){l + 3 (t)) 
| xxSxjt) + x 2 5 2 {t) + x 3 5 3 (t) - rri ai (£)/?!(£) log 
xiai(t) + x 2 a 2 (t)(l + + x 3 a 3 (t)(l + /%(t)) ' 



" a^a^t) + aj 2 a 2 (t)(l + /%(<)) + ^3« 3 (*)(1 + /%(*)) ' 

si*i(t) + 2:2*2(0 + x 3 S 3 (t) -xiai(t)/3i(t) logF(t) 



nai(t) + x 2 a 2 (t)(l + + x 3 a 3 (t)(l + &(*)) ' 

Then g, y> and ^ satisfy the relation (2.1). 

Remark 3.1. W^e make the following immediate comments based on the 
above general assumptions. 

(1) (3.13) implies that (2.18) holds for A(t,x,q). 3.12 implies that (2.19) 

holds for ip and (2.20) holds for ip . Therefore, the Condition 2.5 holds. 
As a result, ip(t,x) andi/j(t,x) are bounded for (t,x,q) € [0,T]xK 3 xR 
for any T > 0, viewing q as a dummy variable of (p(t,x) and ip(t,x). 

(2) The boundedness of cti(t) (1 < i < 3) on [0, 00) is just assumed for 

convenience, since the numerators and denominators of g, tp, and ip 
are linear in c*i (1 < i < r). 

(3) (2.26) is equivalent to 

(3.17) ^ = g{t,x{t),q{t)) 

with initial condition q(0) = 2/4(0). By the form of g, fix T > 0, we 
know that for any given K s valued function x(t) on [0,T] , there exists 
a unique solution q^_(t) of (3.17) on [0, T]. 

(4) By Remark 4-2, h(t, y) = xA(t, y) satisfies the Lipschitz condition since 

A(t,y) is bounded on [0,T] x K 3 x R for any T > 0. 

We prove in the next lemma that (2.28) and (2.29) are satisfied and it 
follows the uniqueness of the C K 3 xR [0, oo)-martingale problem for (Ga,/J-)- 

Lemma 3.1. Make the general assumptions on cti(t), 0i(t), and 5i(t) 
(1 < i < 3), F(t) and A(t,x,q) above. Then for fixed T > and any two 
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solutions (x(t), q x (t)), (x(i), q x (t)) of (2.25) and (2.26) on [0, T], t/iere exisis 
M > 0, suc/i that q x {t) and q x (t) satisfy 

(3.18) f\q x (t) - qit(t)) 2 dt < M T ||x(t) - x(t)|| 2 dt forO<s<T. 
Jo Jo 

We conclude that the Ck3 x r[0, oo) -martingale problem for (Ga,^) restricted 
to Cc(K s x R) has at most one solution. 

We give in the next corollary the conditions which can guarantee the weak 
convergence of {Y^f^O < t < oo} to {y(t),0 < t < oo}. 

Corollary 3.1. In addition to the general assumptions, we assume that 
{<Pn}, <P an d {iPn}, ip satisfy that for any T > 0, 

(3.19) lim sup sup |^jv(£,x) — (p(t, x)| = 0, 

N ->°°0<t<T xe K% 

(3.20) lim sup sup |^;jv(i, x) — ip(t,x)\ = 0. 

^oo <Kr xeJf 3 

Suppose that 

(3.21) lim sup sup c2t/(.Ajv(-, x, g), ^4(-, x, g)) = 

and that P(Y N (0))" 1 /i for some fi G ^(if 3 x £/ien f/iere ex- 
ists on some probability space (O, J^, P) a stochastic process Y satisfying 
-P(Y(0)) -1 = fj,, which is the unique solution of the C^3 x jj[0, oo) -martingale 
problem for (Ga, m) restricted to C^(K 3 x i?) and for P-a.s. w£fl, Y(i, u;)' 
is i/ie unique solution of (2.25) and (2.26), such that Y^ =>■ Y. 

Proof. Note that (3.19) and (3.20) imply the Condition 2.4, and (3.21) 
implies the Condition 2.3. □ 

Remark 3.2. The conditions in (3.19) and (3.20) are very general. One 
sufficient condition to guarantee (3.19) and (3.20) is to assume that for any 
T > 0, af(t), 13? (t), 6?(t) (l<i<3), and F N (t) converges uniformly to 
ai(t), 0i(t), 5i(t), and F(t) on [0,T]. 

3.3. Fixed points of the example. In this subsection, we consider the fixed 
point problem for the example. Make assumptions for A(x, q) = (ajj(x, g))3x3 
as follows: for each (x, q) 6 K 3 x R, 

1) A(x, q)e = 3x i, where e = [1, 1, 1]'; 

2) < aij(x,q) < 1, for 1 < i,j < 3, i / j; 
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3) 1 - Ej^i Oij(x, q) > for 1 < i < 3. 

The above assumptions imply that for each (x, q) 6 K 3 x i?, F 3 + A(x, q) is a 
stochastic matrix. Assume also that A(x, q) satisfies the Lipschitz condition 
and is bounded on K 3 x R. Then all the conditions related to A(pc, q) required 
by Lemma 3.1 are satisfied, if viewing A(x,q) as a matrix- valued function 
on [0, oo) x K 3 x R. 

Next, we assume that in (3.15) and (3.16), cti(t), ft(t), and 5i(t) (1 < i < 
3) and log F(t) are constants which are denoted by ati, ft, Si (1 < i < 3) and 
logF. Assume also that for any x € K 3 , x±a\ +X2a2(l+ft)+2; 3 a 3 (l+ft) ^ 
0. Then all the conditions related to y?(x), ?/>(x) and g(x,q) required by 
Lemma 3.1 are satisfied. 

To get the fixed points of the following system, 

(3.22) = A(x(t),q(t))'x(t), 

(3.23) ^ = g(x(t),q(t)), 

we need to solve the following equations: 

(3.24) A(x,q)'x = 0, 

(3.25) g(*,q)=0. 

Note that we use x € if 3 as a column vector. 

At first, we assume that u\ / 0, ft / 0, 8263 > 0. We know that g(x, q) 
is of the following form: 

(o 2 p.) ' Xiai + x 2«2(l + ft) + 2:303(1 + ft) 

^ xiSi + X2S2 + x 3 <5 3 - xiaift logF 



xiai + X2a 2 (l + ft) + x 3 a 3 (l + ft) 
Then (3.25) implies that for x € -KT 3 with x\ + 1 0, we have 

xiaift log F - xi Ji - x 2 ^2 - x 3 5 3 

(3.27) g x = . 

XlCClft 

Note that for any x € K 3 with xi = 0, (3.25) implies that X2 = x 3 = by 
the assumption <52<5 3 > 0, which contradicts with x\ + 2:2 + 2:3 = 1- Therefore, 
any x £ K 3 with x\ = does not solve (3.25). 

(3.27) defines a function q x : K 3 \ {x € K 3 ,x± = 0} 1— *■ R. It is clear that 
for any x S {x E K 3 , x\ = 0}, lim xl ^o,x^x 9x = 00 or —00. We can actually 
define q x : K 3 1— > R[j{— 00, 00}, where for x G {x € K 3 ,xi = 0}, 

(3.28) g x = lim q x . 
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The function g x with the extended definition is a continuous function on 
K 3 . 

Since A(x, q) satisfies the Lipschitz condition, A(pc, q) is a continuous 
function on K 3 x R. We make more assumptions on A(x,q), such that we 
can extend A(x, q) to K 3 x (R[j{— oo, oo}). Assume that for any x € K 3 , 
linix^x^^-i-oo A(x, q) exists. Then we can extend A(x, q) to K 3 x (R \J{— oo, oo 
by defining 

(3.29) A(x,±oo) = lim A(x,q), 

x— >x,q— >±oo 

where x £ i'T 3 . The extended function ^4(x, q) is continuous on X 3 x (R U{— oo, 
Define for x € if 3 , 

(3.30) T(x) = ^(x,g x )'x + x. 

Since £3 + A(x, q x ) is a stochastic matrix, T(x) is a map from K 3 to i^ 3 . 
Since g x is a continuous function from K 3 to -R1J{— oo, oo} and A(x, g) is a 
continuous function from K 3 x (i?U{ — °°> °°}) to i? 3x3 , we have that T(x) 
is a continuous map from K 3 to K 3 . By Brouwer's fixed point theorem [24], 
there exists fixed points x° € K 3 such that T(x°) = x°. It then follows that 

(3.31) ^(x ,^,,)^ = 0. 

The fixed point of this example might be unique. 

We have to make further assumptions on A(x, q) to exclude the case 
x\ = 0. Each condition as follows guarantees x\ > 0: for arbitrary x € {x € 
if 3 , xi =0}, 

1. a2i(x, ±oo) > and a3i(x, ±oo) > 0; 

2. a2i(x, ±oo) > and 032 (x, ±00) > 0; 

3. a 31 (x, ±00) > and 023 (x, ±00) > 0. 

The fixed point x° determined by (3.30) with > satisfies that (x°, g x o) 
is the solution of the system (3.24) and (3.25), i.e. (x°, q x o) is the fixed point 
of (3.22) and (3.23). 

Remark 3.3. The set of fixed points is a subset of the set {(x, q),x € 

K 3 ,x iai +E 3 = 2 ^( 1 + A) =0,x l a l (3 1 {q-logF) +J2 3 i= i x th = 0}- The 
latter set contains the stationary solutions or explosive solutions of our fi- 
nancial system. 
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3.4. Connection with classical stock price formula. We make the same 
assumptions on af(t), (3^(t), cti(t) and (3i(t) (1 < i < 3) as those in 
subsection 3.2. But we assume that 8^(t), (1 < i < 3), F N (t) defined 
on some probability space (fijv, J^jv, -Pat), with sample pathes satisfying 
the conditions in subsection 3.2 Pn-&.s.; and that 5i(t) (1 < i < 3) are 
Brownian motions, and F(t) is a geometric Brownian motion. Assume that 
(Si , $2 , d~3 , F N ) =4> (Si, 82,83, F) in the sense of weak convergence. Assume 
also all other conditions for A^(t, x, q) and A(t, x, q) used in subsection 3.2. 

Remark 3.4. Duffie and Protter (see [4]) justified the weak convergence 
of properly scaled liquidity demand to Brownian motions. It is also usual to 
assume the fundamental value of a financial asset to be a geometric Brow- 
nian motion. The liquidity demands Si(t) (1 < i < 3) and the fundamental 
value F(t) constitute the random environment for the limit process Y. 

We can follow the procedures in subsection 3.1 and 3.2 to define {Y N (t, u>n), 
< t < oo} and determine {Y(t, to), < t < oo}. As to the determination of 
{Y(t, u>),0 < t < oo} by the nonlinear Volterra Equations of the second kind, 
we note that the Brownian paths Si(t,to) (1 < i < 3) and log F(t,u) sat- 
isfy (3.12) almost surely by the Law of the iterated logarithm. Then we can 
prove that (<5f, 5? , 8$ , F N , Y N ) (S u S 2 , S 3 , F, Y), see the method used 
in [29]. As usual, the Skorohod Representation theorem is the basic tool to 
establish this result. Therefore, without loss of generality, we can assume 
that (Si , 82 , 83 , F N ) and (81,82,83, F) are defined in the same probabil- 
ity space (fl, P) and (81 , 82 , 83 , F N ) converges to (81,82,83^) almost 
surely. Note that for 1 < i < 3, lim7v->oo d(S^(ui), 8i(u)) = implies that 
limjv-»oo d-u(S^ (00), 8i(uj)) = and hence 8f (uj) converges to 8i(u>) uniformly 
on [0, T] for any T > 0. Same thing holds for F N (lo) and F(u). Then we 
actually assumed or verified all the conditions required by Remark 3.2. 

Note that the log price function q(t) in random environment is determined 
pathwisely by the nonlinear Volterra Equations of the second kind. That is 
say, P-a.s for any sample point u € 0, the nonlinear Volterra Equations 
of the second kind determines a unique log price function q(t,u) on [0, 00). 
This is similar to the classical assumption of the stock price formula which 
was suggested by Samuelson [23] in 1964: log St = fit + aWt, where Wt 
is a Brownian motion. Therefore, the interacting agent feedback financial 
system in random environment generalizes the classical stock price formula 
by incorporating the interaction between different types of agents and the 
interaction between the stock price and the empirical distribution of the 
types of agents. 
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4. Proof of Theorem 2.1. At first, we consider the moments for 
{n N (k),k > 0}. Let V = (v\, ■ ■ ■ ,v r )' be a positive vector. For any k > 1, 
by (2.5), (2.6), and the independence of Ejvfci's, we have 
(4.1) 



n 

i=l 



nf (fc+1) 



k 



KW,f( f )) 



, , x n Ar (fc) 



1=1 



It follows by (4.1) that 



(4.2) E 



n N (k + l] 



and for 1 < i < r, 
(4.3) 

nf(fc + l)(nf(fc + 1)-1) 



E 



(n N (k),q N (^)) 

2 



n N (k)P N ,4k,X N (^),q N (^)} 

-^fp^,[fc,x^(A ) ,^ ( ^)]p^. i „[ A; ,x^(A),^ ( ^ ) ]) n f {k)i 



where P N , ti [k, X N (%), q N (±)} is i-th column o£P N [k, X*(£), q N (^)\. Then 

we can get 

(4.4) 



E[(n?(k + l)-n?(k)) 



n N (k),q N (i-)) 



k 



N' 



n N (k)P N ,4k,X"(^-),q"(i-)} ) W\k)P Nr 4kX y (i- T ),q iy (i,)] 



k 



N / * \ ~N 



k 



N, 



E ( PNj-[k, X*(£), g N (^)]P N ,.,[k, X*( £), ) rij^(k) 



3=1 



- 2n Ar (/c)P A r i . i i[A;,X 7V (-^),g Ar (-^)]nf (fc) + (nf (k)f . 

Next, we prove that {Y^} satishes the compact containment condition 
under certain conditions on {Y Ar (0)}, {<?./v} and g. 

Lemma 4.1. Assume that P(Y N (0))" 1 =>• u for some u e g?{K x R), 
and g(t,x,q), g^(t,x,q) satisfy (2.1) and (2.2). Assume also that for any 
T > 0, ip(t,x.,q) andifj(t,x,q) are bounded on [0, T]xKxR and the condition 
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2.4 holds. Then {Y^} satisfies the compact containment condition, i.e., for 
every n > and T > 0, there exists a compact set Krj,T C K x R for which 

(4.5) inf P{Y N (t) G K V ,T, for < t < T} > 1 - rj. 

PROOF. Since P(Y N (0))~ 1 => (i, {^(^(O))- 1 } is tight. For any n > 0, 
there exists b > such that 

infP{ g Ar (0) € /} > 1 -7], 

where / = [—b, b]. 

Fix T > 0, let Ct > be a bound of ip(t,x,q) and tp(t,x,q) on [0,T] x 
K x R. By (1.5), (2.1), (2.2), (2.16) and (2.17), there exists N , such that 
for N > N , we have for any < k < [NT] - 1, 

(4-6) l^(^) - ^(|)| < ^C T [\q N (±)\ + 1], 

which implies that for < k < [NT], 

(4-7) \q N (^)\ < (1 + lc T ) fc [|^(0)| + 1] - 1. 

Let I^t = [-e TCT (6 + l),e TCT (b + 1)]. Since (1 + jjC T ) N increases as N 
does, with the limit e CT , we have for N > Nq 

P{q N (t) G I VtT ,0 <t<T} = P{q N (0) G /}. 

Let K^t = K x then for N > N 

P{Y N (t)eK v , T } = P{q N (0)Gl} 

and (4.5) holds. □ 
Next, we state Lemma 4.2 which verifies (3.10) in condition (e) of Corol- 
lary 3.5 for {Y^}, see [30]. The proof of Lemma 4.2 is given in Appendix 
A. 

Lemma 4.2. Assume that A(t,x,q) = (aij(t,x,q)) rxr satisfies the con- 
dition 2.1 and {A/v(i, x, g) = (a^j j (i, x, q)) r xr} satisfies the condition 2.2. 
Assume that A(t,x,q) is bounded on [0,T] x K x R for any T > 0. As- 
sume that g(t,x,q) and {gN(t,x,q)} satisfy (2.1) and (2.2). Assume that 
( f> ^> fx' fx are con ti nu ous, and the condition 2.4 holds for {^at}, <p and 
{iPn}, If for each f G C^(K x R) and T > there exist measurable sets 
{Fn} G R such that (2.14) holds, then 

(4.8) Jim sup sup sup \N[S N [m] - T]f(x,q) - G A (t)f(x,q)\ = 0. 

N^oo <t<T q€F N vl&K n 
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Remark 4.1. As a special case, we can assume that gN(t, x, q) = g(^-j^-, x, q), 
i.e., ip N (t,x,q) = </?(^l,x,g) and ip N (t,x,q) = ^(^,x,g) ; for (t,x,q) € 
[0, oo) x Kn x -R- Then we do not need to assume the Condition 2.4 to get 
the conclusions of Lemma 4-1 and Lemma 4-2. But the Condition 2.4 holds 
under the stronger condition that ^ and ^ are continuous and bounded on 
[0, T) x K x R for any T > 0. 

Corollary 4.1. If we assume in Lemma 4-2 that P(Y N (0))~ l => fi 
for some fi £ S?(K x R), g(t,x,q) and {giy(t,x.,q)} satisfy (2.1) and (2.2), 
p(t,x,q) and i/j(t,x,q) are bounded on [0, T] x K x R for any T > 0, and 
the Condition 2.3 holds, then {Y^} is relatively compact. If we assume also 
that the Condition 2.5 holds, then any limit point Y ofY N is a solution of 
the Dkxr[0, oo) -martingale problem for (Ga,^) restricted to C^(K x it!). 

Proof. By Lemma 4.1, we know that {Y^} satisfies the compact con- 
tainment condition. Let i*V = Kn x Fn, by (2.15) and Lemma 4.2, we know 
that (3.9) and (3.10) in the condition (e) of Corollary 3.5 [30], hold for {F N }. 
Note that 

\\G A (t)f\\ < \\xA(t,x,q)^\\ + \\^-g(t,x,q)l 

where || • || above is the supnorm with respect to (x, q), and that A(t, x, q) is 
bounded on [0,T] x K x R for any T > 0, g is continuous on [0, oo) x K x R, 
and / has a compact support, we have that ||GA(i)/|| is bounded on [0, T] 
for any T > 0. Then by the proof of Corollary 3.5 [30], we know that the 
equations (2.5) and (2.6) of [30] are verified. Then it follows that {Y w } is 
relatively compact. 

Let K be the support of /, then by (2.1) we get 
(4.9) 

df df 
||GU(t)/|| < max sup || — 1| • sup \\A(t,x, q)\\ + sup |— g| • sup \<p{t,x, 

1 -'- r (x,q)£K OX i (x,q)eK (x,<?)Gif °1 (x,g)£if 

df 

+ sup | — I ■ sup \i/j(t,x,q)\, 
(x,q)eK 0( 1 (x,g)eK 

where 1 1 (t) y* || is the supnorm of GA(t)f with respect to (x, q), and the 
norms on the right side of (4.9) are matrix norm and Euclidean norm used 
in the proof of Lemma 4.2. By (2.18), (2.19) and (2.20), we know that (2.7) 
in the condition (b) of Proposition 2.1 [30] is verified. Then by the proof of 
Corollary 3.5 [30], any limit point Y of Y^ is a solution of the Dk x ji[0, oo)- 
martingale problem for (Ga,^) restricted to C^{K x R). □ 
Now we state Lemma 4.3 and give its proof in Appendix B. 
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Lemma 4.3. If we assume all the assumptions made in Lemma 4-2 and 
Corollary 4-1, then any limit point Y ofY N is a solution of the Ckxr[0, oo)- 
martingale problem for (Ga,^) restricted to C^{K x R). 

It is clear that any solution of the Ck x r[®, oo)-martingale problem for 
(Ga,[J>) restricted to C^(K x R) is a solution of the integral equations (2.25) 
and (2.26). 

Remark 4.2. If A(t,y) satisfies the Lipschitz condition, then b(t,y) = 
xA(t, y) satisfies the Lipschitz condition under the condition that A(t, y) is 
bounded on [0,T] x K x R for any T > 0. But even if (p(t,y) and ^(t,y) 
are assumed to be bounded on [0, T] x K x R for any T > and satisfy the 
Lipschitz condition, we can not claim that b r +i(t,y) = g(t,y) satisfies the 
Lipschitz condition. This is the reason that we need to expand the standard 
theory of nonlinear Volterra equations of the second kind for g(t,y) that 
does not satisfy the Lipschitz condition. 

We need to introduce notations and property related to the nonlinear 
Volterra equations of the second kind with semi-Lipschitz conditions. Let 
V(s, t, y) be a measurable i? m -valued function on [a, b] x [a, b] x R m and 
/ an L 2 ([a, b], R m ) function. Let m = n + 1. We give different notations 
for the first n components of y, V(s,t,y) and f(s). For any vector y = 
(yi, • • • , y n , y n +iY G R n+1 , we let x = (yi, • • • , y n )' . Similarly, we let V(s, t, y) = 
(Vi(s,t,y), • • • , V n (s,t,y))' and f(s) = (fi(s), • • • , /„(s))'. Then we can rep- 
resent the integral equations with kernel V(s, t, y) and a function / as fol- 
lows: for a < s < b, 

(4.10) x(s) = /(«)+ f V(s,t,x(t),yn+i(t))dt 

J a 

(4.11) y n +i(s) = /n+i 00 + / V n+1 (s,t,x(t),y n+1 (t))dt 

The semi-Lipschitz conditions on (4.10) and (4.11) are as follow: 

(I) If (x(t)', y m+ i{t))' is any solution of (4.10) and (4.11), then y m +i0) is 
the unique solution of (4.11) if we plug into (4.11) x(i) = x(i). That 
is to say, there exists a dependence, which is based on (4.11), between 
the first n components and the last component of any solution. Then 
we can actually write y m+ \{t) = £a(t). 
(II) V(s,t,y) satisfies the Lipschitz condition, i.e. there exists a nonneg- 
ative L 2 ([a,6] x [a, b],R) function Vo(s,t), such that for any a < t < 
s < b and yi = {x! x JV +1 )>,y 2 = (x^y^)' G R n+ \ 
(4-12) 

\\V(s,t, yi ) - V(s,t,y 2 )\\ < V (s,t)^\\ Xl - x 2 f + (y« x - yWj* 
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(III) Based on (I), if (x(t)', £ x (i))' and (x(t)',f x (t))' are two solutions of 
(4.10) and (4.11), then there exists a nonnegative measurable function 
-B(s) on [a, b] such that 

(4.13) / S (6cW-6cW) 2 (ft < T ||x(t)-x(t)|| 2 dt for a < s < b, 

J a J a 

and 

(4.14) A f V (s, t) 2 dt(l + B(s))]ds < oo. 

Proposition 4.1. Assume that V is a measurable R n+1 -valued function 
on [a,b] x [a, b] x R n+1 satisfying the semi-Lipschitz conditions (I)-(III) 
above. Then the nonlinear Volterra equations of the second kind (4-10) and 
(4-11) have at most one L 2 ([a, b], R n+1 ) solution. 

Proof. Assume that Vq(s, t) is a nonnegative L 2 ([a, b] x [a, b], R) function 
which satisfies (4.12). Assume that (x(t)', £ x (i))' an d (x(t)', £ x (t))' are two 
solutions of (4.10) and (4.11) and -B(s) is a nonnegative measurable function 
on [a,b] which satisfies (4.13) and (4.14). Let £/(s) 2 = f*V (s,t) 2 dt(l + 
B(s)) for a < s < b and let h 2 = £/(b) 2 . Then by (4.12), Cauchy-Schwartz 
inequality and (4.14), we have for a < s < b, 
(4.15) 

||x(a) -x(s)|| 2 <{ f \\V(s,t,XL(t),Ut)) -V(8,t,x(t),&(t))\\dt} 2 



< / v z ( s ,t)dt [\\x(t)-x(t)r + (ut)-&(t)y}dt 

J a J a 

p s r PS P S 

< / Vo(s,t)dt / \\x(t) -k(t)\\ 2 dt + B(s) ||x(t)-x 

J a \_J a J a 

= £f( S ) 2 f S ||x(i) -X(t)|| 2 (it. 
J a 

Put /c 2 = f% ||x(i) — x(i)|| 2 <ii. By successive substitutions into (4.15), we 
can get 



2 dt 



(4.16) f ||x(t) - x(t)|| 2 dt < fc 2 ^- [ /' */(t; 

in f' \_J a 



2 dt 



,2^ 



for any integer Z > 1 and a < s < b. Let / — > oo, we conclude that x(s) = x(s) 
for s € [a, 6] in the sense of L 2 ([a, b], R n ). By condition (I), we also get that 
£ x (s) = £ x (s) for s e [a, 6] in the sense of L 2 ([a, b],R). □ 
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Lemma 4.4. Assume that A(t,x,q) = (aij(t,x,q)) rxr satisfies the Con- 
dition 2.1 and is bounded on [0, T] x K x R for any T > 0. Assume that 
g(t,x,q) satisfy (2.1). Assume also that ip(t,x, q) and ip(t,x, q) are bounded 
on [0, T] x K x R for any T > and that <p, tp, ^ are continuous. Define 
b(i,y) and b(t,y) fry ^.^J, (2.22,) and (2.23). Assume that either b(t, y) 
satisfies the Lipschitz condition or that the condition 2.6 holds for (2.25) 
and (2.26). Then the Ckxr[0, oo) -martingale problem for (Ga,[J>) restricted 
to Cc(K x R) has at most one solution. 

Proof. First, we prove the case when h(t, y) satisfies the Lipschitz con- 
dition. We just need to prove that the deterministic integral equation (2.24) 
has at most one solution. Define 



(4.17) V(s,t,y) 



b(t,y)' ifO <t < s < T, 

0, if s,t G [0,T] and t > s. 



Note that any solution of the integral equation (2.24) is continuous. By the 
Lipschitz condition on b(t, y), the nonlinear Volterra equations of the second 
kind (2.24) has only one continuous solution, see [26]. 

Second, we prove the case when (2.25) and (2.26) satisfy the semi-Lipschitz 
condition. This proof is similar to the first case. We just need to prove that 
the deterministic integral equations (2.25) and (2.26) have at most one so- 
lution. Define 

(4 18) V(sty) = { ifO<t< s <T, 

1 j v ^ s ^y) S 0) H s ,te[0,T] and t>s; 



and 



V r+ i(s,t,y) 




if < t < s < T, 
iis,te [0, T] and t > s. 



Note that any solution of the integral equations (2.25) and (2.26) is contin- 
uous. We can check easily that the semi-Lipschitz conditions (I)-(III) for 
V(s,t,y) required by Proposition 4.1 are satisfied. Then (2.25) and (2.26) 
have at most one continuous solution. □ 

Remark 4.3. The requirement on g that for fixed T > and any given 
continuous x(t) on [0, T], (2.26) determines a unique solution q x (t) on [0, T] 
looks like a awkward one, but it can be easily satisfied for certain kind of 
functions. For example, g satisfies this requirement if we assume that the 
variable q in <p(t, x, g) and ip(t, x, g) is a dummy variable. 

Proof of Theorem 2.1 The conclusion follows by Corollary 4.1, 
Lemma 4.3, and Lemma 4.4. □ 
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Appendix A: Proof of Lemma 3.1. For fixed T > and any given 
continuous -fT 3 -valued function x(t) on [0, T], we define P x (t) and Q x (t) as 
follows: 



(4.19) 
(4.20) 



si(*)ai(*)/3i(*) 

xi(t)ai(t) + x 2 (i)a 2 (t)(l + + x 3 (t)a 3 (t)(l + /%(<)) 



, m = X! (*) + x 2 (t)(S 2 (t) + x 3 (t)5 3 (t) - Xl (t) ai (t)p 1 (t) log F{t) 



Then (3.17) becomes 
(4.21) 



dq(t) 
dt 



P x (t)q + Q x (t). 



The unique solution of (4.21) with initial condition q(0) = q x (0) is given by 
„ Mu)du / Q x ( u ) e -/o p »M*d« + fa (0) . 



Let hx(t) = Xl (t) ai (t) + s 2 (t)a 2 (t)(l + &(*)) + x 3 (t)a 3 (t)(l + the 
denominator of P x (t). Since cti(t), (3i{t) (1 < i < 3) are continuous and for 
any x € if 3 and t > 0, xiai(t) + x 2 a 2 (i)(l + /%(*)) +a 3 a 3 (t)(l +/3 3 (t)) / 0, 
it follows that 



(4.23) 



£ L < IM*)I < Be/, for all t € [0,T], 



where B[/ > do not depend on x(i). 

We assume that (x(t),g x (t)) and (x(i), <7 x (i)) ar e two solutions of (2.25) 
and (2.26) on [0,T]. It follows that x(0) = x(0) and q x (0) = q x {0). Then it 
is clear from (4.22) that 
(4.24) 



9x (*)-?*(*) = 9x (0) 



+ 



f*P x (u)du f'n / x - f P x (i 
Jo 



_ e / c ;P x (n)^ f Q^ u ) e -So P ^ dv du . 

Jo 

Let Mi = su Po < t < T e /o Px(u)d " V e£ p * (u),iu < oo, then for < t < T, 

(4.25) \efi p ^ du - Jo p ^ du \ < Mi | f P x {u) - P x {u)du\. 

Jo 
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Observe that for < u < T, 
(4.26) 

|Px(«)-J°x(«)| 

xi{u)a\{u)(3i{u) xi(u)ai(u)Pi(u) 



K{u) h*(u) 
ai(u)a2(u)/3i(u)(l + /32(u))[xi(u)x2(u) - xi(u)x2(u)] 



+ 



h x (u)h k (u) 

ai(u)a 3 (?x)/3i(tt)(l + p 3 (u))[x 1 (u)x 3 (u) - xi(u)x 3 (u)} 



h x (u)h x (u) 

ai(u)a2(u)/3i(u)(l + /32(u))[xi(u)(x2(u) - x 2 (u)) + (xi(u) - xi(u))x 2 («)] 



+ 



h x (u)h x (u) 

ai(u)a 3 (u)Pi (u)(l + P 3 (u))[xi(u)(x 3 (u) - x 3 (u)) + (x 1 (u) - xi(u))x 3 (u)\ 



h x (u)h x (u) 



< M 2 ||x(«) -x(it)||, 



where M 2 depends on Bl, Bjj in (4.23) and and (1 < i < 3). Therefore, 

for < s < T, 

(4.27) 

r s rt ™ , * • r t „ , , , rs r ft 



[ S \ e Jo P ^ du - e ti p ^ du \ 2 dt < I" Ml\f \P x (u) - P x {u)\d 
Jo Jo Uo 



dt 



<M(M 2 Z / t \\x{u) -x(u)\\ z dudt 
Jo Jo 

M\M 2 T 2 f s .. 2 

2 y o iix(«) -x(u)fd«. 



< 



Next we consider / 8 [ e /° P * {u)du J* Q x (u)e~ £ P ^ v)dv du-eSl p ^ du J* Q x ( 
x e --fo p ^ dv du] 2 dt. Notice that 
(4.28) 

Jo P * {u)du C Q x (u)e~ So P ^ dv du - eSo p ^ du f Q x {u)e~ So p ^ dv du 



< 



f*P x (u)du f Q^ u ) e -$ u P*b>)dv du _X P ^ u)du f Q x {u)e~So P ^ dv du 
Jo Jo 

So p * ^ du f Q x ( u ) e - So p - ^ dv du - eSo p * ^ du f Q x (u)e- So p * du 
Jo Jo 

So P ^ du f Q x {u)e~ So p ^ dv du - eSo p ^ du C Q x {u)e~ So p ^ dv du 



+ 
+ 

h(t) + I 2 (t) + I 3 (t), 
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where Ii(t) denotes the i-term on the right hand side of the inequality in 
(4.28). Since P x (t) and Q^{t) are continuous functions, there exists M 3 > 0, 

such that for any < t < T, \ Q x (u)e~ fo p ^ v)dv du\ < M 3 . Then it follows 
by (4.27) that for < s < T, 



[ S I^tfdt <M| / |e 
Jo Jo 



2 f s I f*P x (u)du _ f*Px(y)du>2 



dt 



< — — — - — / I x (u) - x (u Wdu. 



(4.30) 



(4.29) 



As to ^2(^)5 we have 

I 2 (t) 2 =e 2 Io P ^ du Aq x («) - Qz(u)}e-So P ^ v)dv du 
Jo 

<Mft Aq x (u) -Q*(u)] 2 du, 
Jo 

pt 

where M4 > satisfies that for any < t < T, e^o p ^ du < M 4 and 

e ~ Jo p ^ u ) du < m 4 . Notice that for < u < T, 

(4.31) 

\Q x (u) - Qz{u)\ 

ai(u)5 2 (u) - a2(u)5i(u)(l + (3 2 (u))] + ai(u)a 2 (u)f3i(u)(l + (3 2 (u)) logF(«) 



< 



K{u)hi,(u) 

x \[x 2 (u)xi(u) - xi(u)x 2 (u)]\ 

[a; 3 (n)xi(ii) - xi(u)x 3 (u)][ai(u)5 3 (u) - a 3 (u)5i(u)(l + 



+ 



+ 



[x 3 (u)x 2 (u) - x 2 (u)x 3 (u)}[ai2(u)5 3 (u)(l + /3 2 («)) - a 3 (it)<5 2 (tt)(l + (3 3 (u))} 



h x (u)hsc(u) 



<M 5 ||x(u) - x(tt) 



where M5 depends on B^, Bjj in (4.23) and a>i, ^ (1 < i < 3) and logF. 
Then it follows by (4.30) and (4.31) that for < s < T, 



(4.32) 



P S P S PL 

/ h{t) 2 dt<MlMl t ||x(u) -x(u)|| 2 dW£ 

j0 JO JO 



< 



m\m 2 t 2 r s 



jx(u) — x(n) || 2 dit. 
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As to 13(f), we have 

I 3 (t) 2 = e 2 Io p ^ du f Q*(u)[e- K p ^ v)dv - e ~ ^ P ^ v)dv ]dt 



(4.33) 



< M?M? 4 



du, 



where Mq > satisfies that for any < t < T, \Qa(t)\ < M§. Similar to 
(4.27), we can prove that there exists M7 > 0, for any < t < T, such that 

(4.34) f\ e -C p ^ dv - e -fo P * iv)dv ] 2 du < M 2 f ||x(u) - x(«)|| 2 du. 
Jo Jo 

Then it follows that for < s < T, 

(4.35) I* h(t) 2 dt< MlMlMlll f ||x(u)-x(u)|| 2 du. 
Jo 2 Jo 

Thus, by (4.28), (4.29), (4.32), (4.35), we get 
(4.36) 

Jo p ^ du f Q x (u) e - X>" p ^ dv du - Jo P ^ du Q*(u)e- K P ^ v)dv du 

||x(u) -*(u)\\ 2 du. 



dt 



By (4.24), (4.27) and (4.36), (3.18) is true for some M > 0. 
The uniqueness of the C K 3 xR [0, oo)-martingale problem for (Ga,(J>) fol- 
lows by (3.18) and Lemma 4.4. □ 

Appendix B: Proof of Lemma 4.2. 

Proof. Let / e C 2 (K x R) and fix T > 0. Assume that K is the support 
of /. For < t < T, and y = (x, q) E X Fn, by Taylor's expansion, (4.2) 
and (2.3) 
(4.37) 

[s N ,[Nt] -J]/(y) 

= E[(X N (t + 1) - x)^(y)'\Y N (t) = y] + E[(q N (t + 1) - q )^(y)\Y N (t) = y] 



E[(Y N (t + 1) - y)0(Yf (t))(Y N (t + 1) - y)'|Y*(t) = y] 



1 , ( [Nt] df 1 

-x^(— ,y)^(y) + -J5 



[Art] + 1 



,x"(t + 



1 



9/ 
iV ; 'V dq 



(y) 



Y*(t)=y 



+ £[(Y w (t + 1) - y)0(Yf (t))(Y w (t + 1) - y)'|Y*(i) = y], 
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where Y?(t) = y + 6?{Y N (t + ^) - y), for some 0? G (0, 1). 
Notice that 



(4.38) 



9N 
9N 

+ 



[Nil + 1 v/V/ 1 , \ 
S^±i.X»( t + l),, 



[Art] + 1 



N 



[Art] + 1 



N 



-c/(i,x,g) 



and 



(4.39) 



.9 



[Nt] + 1 
iV 



a)', 



where §f = [ Jt , • • • , g-] , Xf (t + ) = x + A (X* (t + i ) - x) , for some 



Cf +i e(0,l). 

Then it follows that 
(4.40) 

\N[S N>[m] -I]f(y)-G A (t)f(y)\ 

x[^(M,y)-^,y)]^(y)' 
Y ox 



< 



+E 



(IN 



M±i,x»( ( + I),, 

A 7 " V A^' y 



- 5 



[Art] + 1 



,X 7V (i + -),g) )£-(y) 



1 



A/ 
'JV/ 



Y 



dq 



Y N (t) 



Y' 



<9g 



Y w (f) 



[Art] + 1 



Y 



, x, q ) -g{t, x, ?) ) ^(y) 



Y*(i)=y 



Y£[ 



Y 7V (t + 



Y' 



y)0CY?(*))CY"(* + ^)-y)' 



Y N (t) = y] 



: /i(AT, y, t) + I 2 (N, y, t) + 7 3 (AT, y, t) + h(N, y, t) + I 5 (Y, y, t). 



Notice that for each (x, q) 6 Kjv X -R, Aw(t, x, g) is a constant on [■&, ^jfc^) 
for each fe > 0, we have Ajsf(t,x,q) = An(^Q ,x, q) for t > 0. The norm of 
matrices is defined as follows: for real-valued matrix B = (&i j) r xn = 
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Yaj=i The norm of real- valued r-dimensional vector y = (yi, • • • , y r )' 
is the Euclidean norm ||y||. It follows that ||By|| < ||-B|| • ||y||. Then we have 

,3/, 



h(N,y,t) <\\A N (t,y) - A(t,y)\\ ■ \\ — [y 



(4.41) 

Then it follows by (2.14) that 
(4.42) 



lim sup sup sup I\(N, x, q, t) = 0. 

N-+oo Q<t<T q€F N x£K N 



Next, we consider I 5 (N,y,t). Let ||§^£|| = maxi<j iJ < r+ i \\ 9 y~Q y II and 

fine g N ^ as follows: S^^y) = 9N& y), if (*, y) G [0, oo) x (K f](K N xR)); 
g N x(t,y) = otherwise. By Holder inequality and Cauchy- Schwartz in- 
equality, 
(4.43) 

h(N,y,t) 

}2 . 



d 2 .f 



de- 



J ^j=ij=i 

/[JW] + 1 
■ I 



9 

-Vi? 
iv ^ 

i 



i=i 



1(^(4 + -)-^ 



Xj)| 



1 



Y 7V (t)=y] 



,X*(t + - 



Y N (t) = y 



N 2 



\9 N . 



A 



V N 



N' 



<\\Um{ti(mxnt+^)- Xi )'' 
•* ^ i=i j=i v 



Y N (t)=y 

Y N (t) = y] 



xE[(Xf(t + ^)- Xj ) 



N' 



Y N (t)=y] 



+ J^\\9n,k\\t+iJ2[ E 



t=l 



Y N (t) = y 



+ Jp\\9n,k\\t+i 



where Hs^Ht+i = ^Vo<t<T+i^P ye Kf](K N xR) \9N{t,y)\. By (2.16), (2.17) 
and the assumption that ip(t, x, q) and tp(t, x, q) are continuous on [0, T] x 
K x R for any T > 0, it follows that 



(4.44) 



sup \\g Nk \\ T +i < oo- 
N>1 
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For fixed 1 < i < r, by (4.4), we get 
(4.45) 

N 2 El(X?(t + ±)-x l ) 2 \Y N (t)=y] 

= xA^(M,y) + (*A N J-f,y)f - 2 WM (M,y) - ± |a^(M,y) 

fc=i 

r r 

< Yl \MiA^y)\ + (E I^W,M(*,y)l) 2 + ^ N)i) i(t,y)\. 
i=i i=i 

Then it follows by (4.43), (4.44), (4.45), (2.14) and the assumption that 
A(t, x, q) is bounded on [0, T] x K x R, that 

(aar) lim sup sup sup Is(N, x, g, t) = 0. 

V " ; -/V— >oo o<t<T qG-Fjv xgifjv 

Similarly, by (2.16) and (2.17), we can get 
(447^ lim sup sup sup I 2 (N,x,q,t) = 0, 

V ' ; N ^°°0<t<Tq£F N x£K N 

and by (4.45), (2.14) and some calculations, we can get that 
(a as) lim sup sup sup /3(iV, x, q, t) = 0. 

V " > N ->°°0<t<Tq&F N XL&K N 



Notice that for any (x,q) <E K x R and < t < T, 
(4.49) 



l4(N,x,q,t)< sup sup 



, [Nt] + 1 
fi-l ,x,g )-5(t,x,g) 



sup k-(y) , 



then it follows by the uniform continuity of g(t, x, q) on the compact set 
[0, T + 1] x K that 

(4 e:rA lim sup sup sup Ii{N, x, g, t) = 0, 

V ; ^^0° 0<t<T geFjv xeXjv 

and (4.8) is proved. □ 

Appendix C: Proof of Lemma 4.3. Assume that Y = (X, Q), where 
X = (Xi, • • • , X r ), is a limit point of Y N . By Corollary 4.1, Y is a solution 
of the Dkxr[0, oo)-martingale problem for (Ga, ^) restricted on C^(K x R). 
We just need to show that Y is continuous almost surely. 

Fix T > 0. Since A(t, x, q), ip{t, x, q) and ip(t, x, q) are bounded on [0, T] x 
K x R, there exists Ct > 0, such that for 1 < i < r, 
(4.51) 

sup sup \bi(t, y)| < Ct, sup sup |^(i, y)| < C T , sup sup |V>(*>y)l< 

0<t<Ty£KxR 0<t<Ty&KxR 0<t<TyeKxR, 
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By (2.16) and (2.17), there exists N such that for N > N , we have 
(4.52) 

sup sup \(pN(t,y)\ < C T + 1, sup sup |V>jv(t,y)| < C T + 1. 

0<t<Ty£K N xR 0<t<Ty£K N xR 

Let fi(x,q) = xi,l<%< r. It follows that // e C 2 {K x R) for 1 < i < r 
and 1 < j < 4. We assume that {J^ s ,0 < s < oo} is the filtration to which 
the Dkxr[0, oo)-martingale problem for (Ga,^) referred. Then Xf(t) — 
j J^X^y^Xiu) x A>, Y(u))du = Xj(t)-j ^{X^u^hiu, Y(u))du 
is an {^ s }-martingale for 1 < i < r and 1 < j < 4. Let < s < t < T, and 
fix 1 < i < r, it follows that 

(4.53) £[(*i(t) - Xi(s)y] = jE[ f\Xi(u) - X^^u, Y(u))du] 



for 1 < j < 4. Then by (4.53), for j = 2, we have 

E[{Xi(t) - Xiis)) 2 } <2E[f \Xi{u) - X t {s)\\b t {u,Y{u))\du] 
(4.54) Js 

<2C T {t-s). 
By (4.53) and (4.54), for j = 4, 

E[(Xi(t) - Xi(s)) 4 ] <4C T E[J* \Xi(u) - Xi{ S )\ 3 du] 
KACTElj^X^-Xiis^du] 
<4C T f t 2C T (u-s)du 

J s 

<4(C T )\t-s) 2 . 

Then by Kolmogorov's Criterion, we proved for 1 < i < r that X{ is contin- 
uous almost surely. 

Next, we prove that Q is also continuous almost surely. We introduce the 
notations in Chapter 3, Section 10 [5]. Let (E,r) be a metric space. For 
x E De[0, oo), define 

(4.56) J(x)= e~ u [J(x, u) A l]du, 

Jo 

where J(x, u) is defined by 

(4.57) J(x,u) = sup r(x(t),x{t-)). 

0<t<u 
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Since Y is a limit point of Y , we have that a subsequence {q Nk } of {q N } 
converges weakly to Q. To prove that Q is continuous almost surely, by 
Chapter 3, Theorem 10.2 [5], it suffices to prove that J(q Nk ) =4> as k — > oo. 
In this case E = R and r is the Euclidean metric. It is enough to show that 
Mm k .+ 00 E[J(q N *)]=Q. 

By Lemma 4.1, {q Nk } satisfies the compact containment condition, i.e. 
for any rj > and T > 0, there exists Bt > 0, such that 

(4.58) infP{ \q Nk (t)\ < B T , < t < T} > 1 - 77. 

k 

By the construction of q , (1.5) and (4.52), for fixed Nk > Nq and < u < 
T, 

(4.59) 

J{q N \u)= max 



1 

< — max 
" iV fc o^.^I^l 

<^(C7 t + 1)(Bt + 1), 

on the event F fcjT = {Ig^HOI < 5 T,0 < t < T}. It follows by (4.58) and 

(4.59) that 

E[J{q Nk )\ <e~ T + E[ [ T e- u (J(q Nk ,u) Al)du] 
Jo 

(4.60) < e ~ T + E[ [ T e~ u (J(q Nk ,u) A l)du X F k T ] + P{F^ T ) 

Jo 

< e~ T + ^-{C T + 1)(B t + l)+v- 

Let k — > 00 and then let T — > 00, r] —> 0, we proved that lim^oo E[J(q Nk )] = 
0. □ 
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